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1 .  Introduction. 


In  this  paper  we  give  a  compact  development  of  the  basic  theory  of 
spectral  multiplicity  for  second-order  stochastic  processes.  This  theory  gives 
a  representation  of  a  large  class  of  such  processes  in  terms  of  a  sum  of 
filtered  mutual ly-orthogonal  orthogonal  increment  (o.i.)  processes.  The 
representation  has  been  found  very  useful  in  applications  to  nonGaussian 
signal  detection  [1]  and  to  communication  through  channels  perturbed  by 
additive  noise  [2],  [3j,  especially  when  the  channel  has  feedback. 

The  theory  to  be  developed  here  originated  in  the  work  of  Cramer  [4]  and 
Hida  [5].  Our  development  is  directed  toward  obtaining  the  spectral  represen¬ 
tation  in  the  elegant  form  given  by  Hida.  Several  paths  are  available:  one  may 
simply  quote  Hida's  results;  one  may  quote  the  Hel 1 inger-Hahn  theorem  (on 
which  Hida's  results  are  based)  and  then  adapt  that  result  to  the  representa¬ 
tion  of  a  second-order  stochastic  process;  one  may  prove  the  Hell inger-Hahn 
theorem,  then  do  the  adaptation;  or  one  may  give  a  direct  proof  of  the  spec¬ 
tral  representation.  It  is  this  last  path  that  will  be  followed  here.  It  has 
some  advantages  over  simply  proving  the  He 11 inger-Hahn  theorem,  since  some 
readers  may  be  more  comfortable  with  second-order  stochastic  processes  than 
with  abstract  Hilbert  space;  our  development  also  gives  some  nice  applications 
of  RKHS  (reproducing  kernel  Hilbert  spaces)  theory.  Moreover,  as  a 
consequence  of  the  development,  we  actually  prove  the  Hell inger-Hahn  theorem, 
and  it  is  stated  at  the  end  of  the  paper.  Although  the  spectral 
representation  is  well-known,  there  does  not  seem  to  be  a  readily-accessible 
development  that  yields  the  form  given  by  Hida.  Since  the  development  here  is 
explicit  and  based  on  RKHS  theory,  it  may  be  useful  in  extensions  to  second- 


order  random  fields. 


2.  Raslr.  Definitions  and  Structure 

Let  T  be  an  Interval  In  IR.  For  simplicity,  we  denote  the  end  points  as  -® 
and  +»,  but  actually  T  can  be  any  interval,  finite  or  infinite,  open,  half¬ 
open,  or  closed.  (Xt).  t  in  T.  is  a  second-order  stochastic  process  (SOSP)  on 
the  probability  space  (O.P. P).  <*.*>  will  denote  the  inner  product  in 
LgCfl.p.P],  with  11*11  the  corresponding  norm.  Lt(X)  will  denote  the  closure  in 
Lo(fi.0,P)  of  span{X  .  s£t).  with  L(X)  the  closure  of  span{X  .  sCT}.  All  equal- 
ities  given  here  are  in  the  sense  of  L^Q.p.F);  thus  x  =  y  means  that  x  and  y 

are  equal  a.e.  dP;  x  =  Z?y  means  that  (5^y  )  converges  to  x  in  Lo(O.0,P)  as 

in  in  / 

N  The  following  two  assumptions  will  be  made: 

(Al)  (X^)  is  mean-square  left-continuous  on  T.  the  mean-square  right 

+  2 

limit  X  exists  whenever  t  €  T,  and  sup  IIX  II  <  ®; 
t  t€T 

(A2)  fl  L  (X)  =  {0}. 
s€T  S 

Assumption  Al  implies  that  the  reproducing  kernel  Hilbert  space  (RKHS)  of 
the  correlation  function  of  {X^. ) ,  which  we  denote  here  as  H(X).  is  separable, 
as  is  L(X).  A  SOSP  which  satisfies  A2  is  said  to  be  purely  nondeterministic. 
These  two  assumptions  give  rise  to  a  left-continuous  resolution  of  the 
identity,  as  follows.  Let  Pt  be  the  projection  operator  mapping  the  Hilbert 
space  L(X)  onto  L^CX).  The  following  result  is  an  immediate  consequence  of 
assumptions  Al  and  A2. 


Lemma  1:  The  family  (P^ )  has  the  following  properties: 

(a)  If  s  >  t.  then  PgPt  =  PtPg  =  Pt: 

(b)  P_  =  P„.  for  all  t  such  that  t-  €  T.  where  P.  x  =  lim  P  x  for  all  x 

t  t-  t-  ..  s 

s|t 

in  L(X) ; 

(c)  P  s  lim  P  =0  (operator); 

si-®  8 
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(d)  P  =  lim  P  =  I  (identity  operator  in  L(X)). 

'  W  S 

S  ]°° 

The  limits  in  (c)  and  (d)  are  in  the  strong  operator  topology;  e.g.. 

P  =  lim  P  x  =  0  (element)  for  all  x  in  L(X). 
xi-«  S 

It  should  perhaps  be  noted  that  m.s.  left-continuity  of  (X^)  is  not 
necessary  for  left-continuity  of  the  family  {P^,  t  €  T).  For  example,  let 
T  =  [O.l].  let  (W^)  be  the  standard  Wiener  process,  and  define 

Xt  =  -Wt  for  t  <  £ 

=  +Wt  for  t  *  £• 

2 

Then  IIX t  -  X^ll  =  3t  +  2  for  t  <  2.  so  (X^)  is  not  m.s.  left-continuous  at 
t  =  i.  However.  X^  €  sp{Xs>  s  <  K}.  so  L^X)  =  L^JX).  and  LJX)  =  Lt  (X)  for 
t  in  (0,T] . 

The  left-continuity  of  (Pt)  is  thus  a  weaker  property  than  m.s.  left- 
continuity  of  (Xt).  This  property  gives  rise  to  other  m.s.  left-continuous 
processes,  as  follows. 


Lemma  2’  Let  y  be  in  L(X),  and  define  Z t  =  P^y.  Then  (Z^ )  is  m.s.  left- 

continuous,  Z  exists  for  all  t+  in  T,  and  sup  |Z  |  <  ®.  Moreover,  (Z  )  is 
1  t€T  1  Z 

purely  non-determlnistic  and  has  orthogonal  increments. 


Proof:  The  fact  that  (Zt)  is  m.s.  left-continuous  follows  by  lef*  continuity 

of  ( P  ) .  Z  exists  since  the  limit  P  =  lim  P  exists.  Sup  HZ  II  £  My  II.  (Z  ) 
C  1  sit  S  tCT  1  1 

is  purely  non-deterministic  since 


If  t^  >  tg  2  tj.  then 


n  l  (z)  c  n  l  (X)  =  0. 

t€T  tCT 


E(Z  -Z  )Z  =  <(P  -P  )y,P  y>  =  0 
*3  l2  *1  *3  l2  *1 
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since  (P  -P  )x  1  L  (X)  =  range(P  ). 
l3  2  ll  ll 

Lemma  3:  (P^)  has  a  finite  or  countably-inf inite  number  of  points  of  discon¬ 
tinuity.  If  t  and  s  are  two  such  points,  distinct,  with  P^x  =  0,  Pt+x  =  x  and 

P  y  =  y.  P  y  =  0.  then  x  1  y. 
s  ■  s 

Proof:  If  Pt+x  =  x,  P^x  =  0.  then  x  1  Lv(X),  v  £  t.  proving  the  second  state¬ 
ment.  The  first  statement  then  follows,  since  separable  L(X)  contains  at  most 
a  countably-inf inite  number  of  mutually  orthogonal  elements. 

3.  Canonical  Representations 

Suppose  now  that  one  could  find  a  family  {(Z”),  n£l}  of  mutually  ortho¬ 
gonal  stochastic  processes,  each  with  orthogonal  increments,  such  that  the 

closed  linear  span  of  {(Zn).  n  ^  1;  s  €  (-»,t]}  =  L  (Z)  contains  L  (X)  for  all 

s  t  t 

t  in  T.  Then,  since  the  subspaces  Lt(Zn)  are  orthogonal  for  fixed  t  and  dif¬ 
ferent  values  of  n,  L  (X)  C  ffi  L  (Zn)  (i.e.,  x  in  L  (X)  =>  x  =  Z  x  . 

n*l  n  n 

x^  €  Lt(Zn)).  Processes  (Z1?)  having  such  properties  are  called  innovations 
processes  for  (X^).  The  number  of  terms  in  the  index  set  is  the  multiplicity 
of  the  innovations  process.  We  will  first  show  that  there  always  exists  an 
innovations  process  for  (X^)  and  \hen  prove  the  existence  of  an  innovations 
process  of  minimal  multiplicity.  For  example,  if  (Xt)  has  orthogonal 

increments,  then  the  minimal  multiplicity  is  one. 

X 

It  can  be  that  L„(X)  C  (  L  (Z  )  where  (Z  )  are  o. i .processes,  but  with 
t  -  t  n  n 

n=l 

the  reverse  Inclusion  not  holding.  A  representation  of  the  form 

N 

Lt(X)  =  ®  Lt(ZR)  for  all  t  in  T,  with  (Z^)  being  o. i .processes,  is  called  a 
n=l  n  n 

canonical  representation  for  {X^ ) . 
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The  natural  question:  when  does  a  SOSP  (Xt)  have  a  canonical  representa¬ 
tion?  We  note  first  that  if  T  =  R  and  )  is  m.s.  continuous  and  wide-sense 

stationary,  then  X  =  j‘_>e^tdY(X)  where  Y(X)  is  a  PND  0  ±  P. 

t  IK 

Theorem  1 :  Suppose  that  (X^. )  is  a  SOSP  satisfying  assumptions  (A— 1 )  and  (A-2). 
Then  (X ^ )  has  a  canonical  representation. 

Proof :  Since  the  RKHS  H(X)  of  X  is  separable,  then  by  the  isometry  between 
L(X)  and  H(X)  (Theorem  IX. 2),  L(X)  is  also  separable.  Thus,  there  exists  a 
countable  CONS  (Zn)  for  L(X).  Define  elements  (Z^)  as  follows.  Let  Zj  =  l} . 

Given  Zj ,Zg . Zn>  let  Pn  be  the  projection  operator  in  L(X)  with  range  space 

n  _ 

equal  to  the  closed  linear  span  of  U  L(Z.),  where  L(Z  )  =  span{P  Z. ,  t  £  T}. 

1=1  1  1  11 

/v 

If  range(Pn)  =  L(X),  the  process  is  terminated.  Otherwise,  Z^+j  is  defined  by 

Z.  =  zn+1  -  P  zn+1. 

n+1  n 

If  the  above  procedure  terminates  for  some  finite  n,  then  necessarily 


L(X)  =  span{  U  L(Z  )}.  If  the  process  does  not  terminate  for  some  finite  n. 
1=1  1 

suppose  that  y  €  L(X)  and  y  1  span{  U  L(Z. )}.  Then  y  1  Z*  for  all  i  £  1  by 

HI 

the  construction  of  (Z.  .1^1}  and  so  llyll  =  0.  Thus,  L(X)  =  span{  U  L(Z  )}. 

n£l  n 

Define  Lt(Zj)  =  span{PsZ^t  s  i  t} ,  i  1 ,  t  €  T.  To  see  that 
L  (Z. )  1  L  (Z.)  for  i  /  J  and  all  s.t  in  T,  one  proceeds  as  follows.  By  con- 

V  1  S  J 

struction,  Zj  1  L( Z^)  for  all  k  *  J,  and  ^tZj  =  Zj  -  y^,  where  y^  1  range(Pt). 
Thus,  yQ  1  Lt(Zk),  and  since  Zj  1  L(Z^)  D  L^Z^).  P{Zj  1  Lt(Zj{).  Hence 
PtZj  1  for  all  x  £  t  and  for  all  t  in  T.  By  symmetry,  1  PsZj, 

all  s  i  t,  all  t  in  T.  This  gives  Lt(Zj)  1  Lg(Zjt)  for  j  /  k  and  all  s.t  in  T, 
so  span{  U  L  (Z  )}  =  ®  L  (Z  )  for  all  t  in  T  and  L(X)  =  ®  L(Z  ). 


Since  Lt(Zn)  C  Lt(X)  for  all  n  £  1  and  all  t  in  T,  it  remains  only  to 

show  that  Lt(X)  C  ©  Lt(ZR)  for  all  t  in  T.  We  already  have  that  L(X)  =  ©  L(Z  ) 
n  n  n 

and  L.(Z  )  1  L  (Z  )  for  n^m.  all  s,t  in  T.  Thus,  by  the  continuity  of  the 
t  n  s  in 


operator  P  , 


PtL(X)  =  LJX)  =  Pt[©  L(Zn)] 

n 


=  P  span  U  L(Zr) 
n 

=  span  U  Lt(Zn)  =  9  Lt(Zn). 
n  n 


Definition  1:  Let  (yt).  t  €  T  be  an  orthogonal  increment  process  on  (D.0.P), 
such  that  the  right  m.s.  limit  y  exists  for  all  a  in  T  (except  at  the  right 
end-point).  Then,  p^  will  denote  the  Lebesgue-Stielt jes  measure  on  the  Borel 
sets  of  T  defined  by  p  (a.b]  =  Hyv.ll2  -  Hy  II2.  If  (y  )  is  also  m.s.  left 

y  D+  l 

2  2 

continuous,  then  py[a.b)  =  lly^ll  -  lly^ll  .  ^[p^]  will  denote  the  set  of  all 

# 

Borel -measurable  functions  f:  T  -*  F  (extended  real  line)  such  that 

J*-p | f (t)  |2dpy(t)  <  The  Lebesgue-Stielt jes  measure  p^  defined  by  y  will  be 

called  the  spectral  measure  for  y. 


Corollary:  From  Chapter  VI I I, the  preceding  theorem  shows  that  (Xt)  has  the 

-t 

canonical  representation 


N  rt 

X  =  I  F. (t . s)dB. (s) .  all  t  €  T. 
i=l  J0  1 

M 

where  L  (X)  =  L  (B)  for  all  t  €  T,  L  (B)  =  #  L  (B.).  the  (B.)  are  mutually 

»  v  i  i  1  *  *  * 

orthogonal  o.i.  processes.  Bj(t)  =  P^.  Fj(t.s)  =  0  for  s  >  t,  and  F1(t,*) 
belongs  to  LgCdpg  ]  for  all  t  £  T,  all  1  £  M. 
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Remark .  Suppose  that  (y  )  is  such  that  y  €  L  (Z)  for  all  t,  where  Z  €  L(X). 

t  t 

Then  y  =  J^f ( t . s)dPgZ  for  all  t  €  T.  This  gives  llyt+ll2  = 

J^jf (t.s)  |2dp^(s)-  Thus.  py  «  p This  result  will  be  used  frequently. 


Proposition  1:  Suppose  (Xt)  has  the  representation  given  in  the  preceding 
Corollary,  except  that  it  is  not  known  whether  or  not  Lt(B)  =  Lt(X)  for  all  t 
in  T.  This  equality  then  holds,  for  all  t  in  T.  if  and  only  if  the  following 
condition  is  satisfied'-  For  every  t  in  T. 

M 

2  J>fc#Fi(s*u)8j(u)d»JB  ( u )  =  0  for  a11  s  £  1 

M  r  9 

implies  2  J_Jg i(u)|  dp„  (u)  =  0. 
i=l  i 

This  condition  can  be  restated  as  follows:  For  every  t  in  T.  and  every 
1  $  M.  {F^s.*).  s  i  t}  is  complete  in  ^[(-“.tj.Pg  ]. 

Proof :  Every  element  in  Lt(Bj)  has  the  form  J^g.  (sJdBjCs)  for  some  gj  in 
LgCPfi  ]•  from  Chapter  VIII.  If  Lt(B)  /  Lt(X)  for  some  t  C  T.  then  there 

M  t 

exists  an  element  Z^  =  Z  J _ajg^(s)dBj(s)  in  Lt(B)  such  that  Z t  1  Lt(X).  But 

N 

then,  for  s  $  t.  <Z  .X  >  =  Z  J*  F  (s,u)g . (u)dp„  (u).  Thus,  in  order  that 

t  S  1  =  i  1  Dj 

Lt(B)  /  Lt(X),  it  is  necessary  (and,  obviously,  sufficient)  that  there  exist 

M  ,  2 

elements  (gj.  i  ^  M},  gj  €  L2(pg  SUCh  that  2  l^i (u)  i  ^  *  °*  whil 

N 

Z  X^FjCs.uJg^uJdpg  (u)  =  0  for  all  s  $  t. 

This  proves  the  statement  for  the  first  condition.  The  alternate  (equiv¬ 
alent)  condition  then  clearly  holds,  using  the  fact  that  every  element  g^  in 
LgCPfi  ]  defines  an  element  in  L^Bj)  having  the  representation  (s)dBi(s) 


4.  Proper  Canonical  Representations 


Theorem  1  proves  the  existence  of  a  canonical  representation  for  (X t ) . 

The  Corollary  gives  a  very  useful  representation  of  Xt  for  each  t  €  T,  when  a 
canonical  representation  exists.  However,  the  number  of  terms,  M,  appearing  in 
the  series  is  not  specified,  nor  do  the  measures  (p^  )  have  any  particular 


relationship  to  each  other,  nor  is  anything  said  about  uniqueness.  These 
points  will  all  be  addressed  as  we  now  proceed  to  obtain  a  proper  canonical 
representation. 


Definition  2-  Let  S(X)  be  the  closed  linear  span  of  all  elements  x  in  L(X) 
such  that  for  some  discontinuity  point  t^  of  {P^.  t  €  T}.  P£  x  =  0,  Pgx  =  s 

for  s  >  tj.  Define  the  subspace  *€{X)  C  L(X)  by  ^(X)  =  SD(X)£,  the  set  of  all 
elements  y  in  L(X)  such  that  y  1  S(X). 


We  have  already  seen  that  right-m.s.  continuity  of  (Xt)  at  t^  is  not  a 
necessary  condition  in  general,  for  P  =  P  .  However,  if  (X  )  is  an  OIP, 

'o  V 

then  right-m.s.  continuity  of  (X t )  at  t^  is  a  necessary  and  sufficient 

condition  for  P  =  P  .  One  notes  that  for  t  £  tn,  for  (X  )  an  OIP, 
t0  C0  u  1 

E|X  +  -  Xt  I2  =  £lXt  +  "  Xt  +  Xt  "  XJ2 

V  'o  o  o  lo  l 

=  E|X  +  -  X  I2  +  E|X  -  X  I2  ^  E|X  +  -  X  I2. 
l0  0  0  0  0 


From  a  Hilbert  space  viewpoint,  X  is  the  unique  element  in  L  (X)  which  is 

Z0  C0 


nearest  to  Xt+  when  {X^. )  is  an  OIP.  In  the  general  case,  of  course,  this  need 

2 

not  be  true,  so  that  X  can  belong  to  L  (X)  even  though  E|X  -  X  |  = 

l0  t0  0  0 

IIXt  -  X  II2  >  0. 

V  0 
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Lemma  4'-  Let  P  be  the  operator  in  L(X)  defined  by  P  u  =  lim  P  u.  Then 

V  V  sh0  s 

P  is  well-defined  for  each  t~€  T  (except  the  right  endpoint)  and  P  is  a 
t0+  U  t0 

projection  operator. 


Proof :  See  Theorem  IV. 10. 


Proposition  2-  x  €  *€(X)  <=>  t  -*  IIP^xll  is  continuous  on  T. 


Proof :  Note  first  that  t  -»  IIP  xll  continuous  at  tn  is  equivalent  to  P  x  -*  P  x 

t  u  t  tQ 

as  t  I  t^,  since  (P^ )  is  already  half-continuous  on  T  and  for  t  >  tQ, 

IIP  x  -  P  xll^  =  IIP  xll^  -  IIP  xll^.  Thus,  t  -*  IIP  xll  continuous  on  T  is 

t  t0  t  tQ  t 

equivalent  to  P  x  =  P  x  for  all  tft  such  that  tn+  is  defined.  Now.  suppose 
t0  tQ+  u  u 

that  t  -»  IIP  xll  is  continuous  on  T  and  that  P  y  =  y,  P  y  =  0.  Then  for 
1  0  0 

t  >  t»,  <x,y>  =  <x.P  y>  =  <P  x,y>.  Since  P  x  =  P  x,  this  gives 

u  t  t  tQ  tQ+ 

<x.y>  =  <x.P  y>  =  <P  x.y>  =  <P  x,y>  =  <x,P  y>  =  0.  Thus,  x  1  ffl(X). 

V  0  Z0  0 

Conversely,  suppose  that  x  €  <6(X),  and  that  t  -»  IIP^xll  is  discontinuous  at 

t  =  tn.  Then  IIP  xll  =  IIP  xll  +  a,  where  o  >  0.  Let  x^j  =  P  x  -  P  x;  then 
u  tQ+  tQ  u  tQ+  tQ 

IIXqII  =  a  and  Xq  1  range(Pt  ),  so  P(  +Xq  =  Xq.  Pt  Xq  =  0;  Xq  belongs  to  S(X). 
Then  <x,Xq>  =  <x,Pt  +Xq>  =  <Pt  +x,  Xq>  =  IIXqII^  =  a.  tThis  contradicts 

xia(x).  0 

M 

Proposition  3  :  Suppose  that  Z  €  'C(X).  Then  L^(Z)  =  ©  Lt(Zn),  M  £  where 

1  n=l 

L  (Z)  =  span{P  Z,  s£t);  {(P  Z  ),  n^l)  is  a  family  of  mutually  orthogonal  m.s. 
t  $  t  n 

continuous  processes,  each  with  orthogonal  increments. 
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Moreover,  if  y  €  L^(2),  then  there  exists  (F^ft.*),  n  £  M}  depending  on  y 


and  such  that 


y  ’  J,  LFn(t  s)d(PsZn> 


where  F  (t.s)  =  0  for  s  >  t  and  F  (t.*)  belongs  to  L0[dji  ].  for  each  t  in  T. 
n  n  z  £n 

Proof  •  If  Z  C  ^(X),  then  by  Prop.  2,  t  -»  IIP^ZII  is  continuous,  so  (P^Z)  is  a 

2  2 

purely-nondeterministic  m.s.  continuous  process.  Moreover,  IIP^ZII  £  IIZII  ,  all 
t  in  T.  The  existence  of  a  canonical  representation  then  follows  from  Theorem 
1.  The  representation  of  y  in  (Z)  follows  from  tb-*  previous  results  on 
SOSP.  D 


Suppose  that  t^  is  a  discontinuity  point  of  the  family  {P^,  t  €  T}  of 
projection  operators.  We  use  M(ti)  to  denote  the  dimensionality  of  the  sub¬ 
space  of  L(X)  spanned  by  the  elements  y  which  satisfy  P  y  =  y,  P  y  =  0. 

V  *i 

M(t.)  is  thus  the  multiplicity  of  the  eigenvalue  1  for  the  projection  operator 

Pt  +  -  Pt  * 
i  i 


Proposition  4:  For  each  t  in  T, 


*(tj 


M  /»  "v-j/ 

Xt  -  Z,  *  l  l 

11=1  1  tt<t  j  =  l 

where  {B^,  n^l}  is  a  mutually  orthogonal  family  of  o.i.  processes,  each  m.s. 

continuous;  Fn(t,s)  =  0  for  s  >  t  and  Fn(t,*)  Is  *n  ^  ^or  n  (tj) 

n 

are  the  discontinuities  of  (pt)>  and  the  J  £  M( ^ ^ •  i£l}  are  o.n.  random 

variables  such  that  for  all  discontinuity  points  t . ,  P  /  P  . 

l  tj+  tj 

Vu  -  *iS  for  s  >  'i 

V*j  1  0 

for  j  =  1.2, .. . .MCtj). 
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Proof :  Immediate,  using  Prop.  3  and  the  definitions  of  *€(X)  and  2)(X). 


Proposition  5:  For  the  representation  of  X^.  given  in  Prop.  4,  and  each 
discontinuity  point 

l<xti+.^ij>l  >0  all  j  ^  M(tj) 


where  M(ti)  and  {'i'.j,  j  <  M( t j ) .  i  £  1}  are  defined  as  in  Prop.  4. 


Proof :  If  not,  then  since  .  1  range(P  )  for  s  £  t . .  <X  .'p.  >  =  0,  all 

1 J  S  1  S  1 J 

s  <  t  ;  if  also  <X  .x/'.  .>  =  0  then  P  =  0.  since  rangefP  )  = 

1  Z^  +  1J 

FI  L  (X).  This  contradicts  Prop.  4.  Q 

s>t  ^ 


Corol  lary:  Let  (Z^)  be  the  projection  of  (xt)  onto  ®(X) .  Then  (IIZ^II)  has  jumps 
at  all  t^;  the  jump  at  t^  has  magnitude  equal  to 

M(t±) 

2  l<Xt 

j=l  i  J 


Proof:  The  sum  is  the  squared  norm  of  the  projection  of  (X^)  onto  the  subspace 
spanned  by  the  eigenvectors  of  P  -  P  . 

V  i  ° 

Proposition  6:  Suppose  (Xt)  has  orthogonal  increments.  If  Z t  is  the 
projection  of  Xt  onto  S(X) ,  then  t  -»  IIZ^II  is  a  step  function. 

M(ti>,  ,2 

Proof  :  Consider  1  1  |<X  -X  >T  for  t  >  s  l  t  .  As  (X  )  is  PND  and  has 
J=1  5  J 

_  2 
orthogonal  increments,  E(X  -X  )u  =  0  if  u  €  L  (X),  so  that  <X  -X  ,'p.  .>  =  0 

t  s  s  t  S  1 J 

for  t  >  s  >  tj.  Thus,  for  t  >  t^, 

M(ti)  M^)  M(ti) 

2  l<Xt.^li>|2=  2  |<X  -X  +X  *  >[2  =  I  l<Xt+^ii>|2- 

J=1  J  j=l  c  ti  i  j=l  li 
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Corollary:  If  (X^)  has  orthogonal  Increments,  then  for  each  discontinuity 


M(tt) 


point  t.  the  value  of  Z  <X  is  independent  of  t  for  t  >  t  and  is 

1  t  1J  1J  1 


zero  for  t  £  tj. 


Lemma  4'-  Suppose  Y  €  Lt(X)  and  that  Y  is  orthogonal  to  2)(X).  Then  there 

exists  a  family  (®n)  of  mutual ly-orthogonal  m.s.  continuous  processes,  each 

with  orthogonal  increments,  and  functions  (Fn(t,*);  n£M}  on  T  such  that 

(a)  the  measures  (fig  )  are  ordered  by  absolute  continuity: 

n 

fig  >>  fig  for  n  £  M; 
n  n+1 


(b)  F  (t.s)  =  0  for  s  >  t  and  Fn(t,*)  belongs  to  ^[fig  ]  for  all  n  i  M; 

n 

M  t 

(c)  Y  =  Z  J  F  (t.s)dB  (s)  (if  M  =  «°,  then  the  equality  holds  as  a 

t  -  — <*>  j)  n 

n=l 

limit  in  the  mean  as  M  -*  ®) . 

Proof :  We  need  only  show  the  existence  of  a  representation  (c)  having  property 
(a),  since  the  existence  of  a  representation  as  in  (c)  and  (b)  has  already 
been  shown. 

Let  (Z  )  be  orthogonal  elements  in  *6(X)  such  that  P,X  (X)  =  ©  L  (Z  ), 
n  *  i  \ «  t  n 

nil 

all  t  in  T,  P<g  the  projection  of  L(X)  onto  'C(X),  as  in  Theorem  1.  Note  that 
P<gLt(X)  =  spanlP^.  s£t}.  Let  Bj  =  Z  OjZj,  where  |cei  |  /  0  for  all  i  2  1 

n  o  n 

and  Z  Jet.  |  HZ, n  <  «*.  Then,  denoting  F-  as  the  map  t  -»  IIP  Zll  , 

v  i  1  1  b  v 

n21 

f  (t)  =  HP^II2  =  l  |a,  |2IIPtZ1»2  =  l  |«, !%  («). 

1  121  121  1 


Thus,  fig  >>  fi^  for  12  1-  In  fact,  fig  >>  fi^  for  all  v  in  %(X),  since  any 

such  v  has  the  representation  v  =  ZnPnv,  P11  the  projection  of  L(X)  onto  L(Zn). 

and  fi  «  fi^  by  previous  results  (see  the  Remark  following  Theorem  1). 

Pnv  n 
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We  thus  have  in  *€(X)  such  that  Mg  >>  My  for  all  Y  in  ^(X).  Let  L(Bj) 

be  the  orthogonal  complement  in  ^(X)  of  L(B^).  Then  L(B^)^  =  ®nL(yn),  where 
(y11)  is  constructed  from  an  o.n.  set  in  L(Bj)^.  Define  B 2  =  ^ia2iYi*  w^ere 
|a„.  I  >  0  for  all  i,  and  E  |a0.  |2lly?ll2  <  ".  Then  m_  >>  m,  for  all  Y  in 

21  !>i  21  i  nr 

LfBj)1.  and  Mg  >>  Mg  - 

Continuing  in  this  way,  we  obtain  a  sequence  of  elements  {B^,  n<M}  such 

that  Mo  >>  Md  for  n^l.  and  L  (B  )  i  L. (B  )  for  n  /  m,  all  s  and  t  in  T; 
d  d  , ,  s  n  t  m 

n  n+1 

the  last  statement  is  proved  as  in  the  proof  of  Theorem  1.  Moreover,  since 
{L(Bn) ,  nil}  are  orthogonal  subspaces  of  C(X)  and  C(X)  is  separable,  there 

exists  an  at-most  countable  number  of  such  (B^),  and  by  Zorn’s  Lemma  C(X)  = 

M  M 

®  L(^n)  where  B  can  be  infinite.  This  gives  P<gLt(X)  =  ®  Lt(Bn)  for  all  t  in 

n=l  n=l 

T.  Thus,  if  Yt  €  P^^X),  we  have  that  Yt  =  Y",  where  y"  is  the  projection 

of  Yt  onto  Lt(Bn).  Since  Y"  =  X^F/t.sJdP^.  with  E|y”|2  =  JT|Fn(t.s)  |2dMg  . 

n 

the  representation  of  part  (c)  follows.  □ 

A  distinguishing  characteristic  of  the  measures  (Mg  )  defined  in  Lemma  4 

n 

is  that  Mg  >>  Vy  for  all  Y  in  ^(X).  Mg  >>  My  ^or  aH  Y  1  L(Bj),  and 
1  2 

Mg  >>  My  ^or  aH  Y  1  ®”L(B.).  Such  a  set  will  be  called  a  maximal  chain  of 
n+1  1 

measures.  The  preceding  result  shows  the  existence  of  a  canonical 
representation  such  that  the  measures  defined  by  the  projection  of  (X^)  onto 
*£(X)  form  a  maximal  chain.  Nothing  has  been  said  about  uniqueness.  This  will 
now  be  addressed. 


Lemma  5:  Suppose  L  (X)  =  ®  L  (Z  )  for  all  t  in  T  with  p_  >•>  p_  for  n]>l. 

v  4  v  I)  £-t  - 

n=l  n  n+1 

"  i 

where  (p_  )  is  a  maximal  chain  of  measures,  M  i  Consider  ®  L(Y  )  C  L(X), 
n  i=l 


-  13  - 


where  p  .  >>  p  .  .  for  i  £  1.  Then  N  £  M  and  p  .  <<4  for  i  £  N. 

yi  yl+i  yi  2} 

Proof :  Clearly  p  .  «  Py  for  all  i  £  N,  since  Z1  is  a  maximal  element.  We  can 
yi  Lx 

assume  M  <  «.  Let  k  $  min(N.M)  be  the  smallest  integer  n  such  that  p  «  p- 

Y*  n 

is  false  (we  will  show  that  no  such  n  can  exist).  Then  p  ,  has  the  Lebesgue 

1 

decomposition  p  k  =  ^  where  ^  <<  p a k  1  p Thus,  there  exists  a 

Borel  ACT  such  that  ok(A)  =  .  M^C*)  =  °*  We  wil1  show  that  CTk[T]  =  °* 

f  dcV|i< 

For  i  <  k.  p^  »  p  i  >>  p  k  >>  ak.  Define  Uj  =  fT|^— j  (sJdP^Zj,  i  <  k. 
^  Y 

f  <kV)4<  i 

and  Vj  =  — I  (s)dpsYj*  i  i  k-  Since  Vj  €  L(Y  ).  we  have  Vj  1  and 

i 


P^Vj  1  PtVj  for  i  X  j.  i.j  i  k.  Similarly.  Uj  1  u^  and  P^  1  PgUj  for  all 
s.t  in  T  and  i.j  $  k-1  such  that  i  *  j.  Note  that  pu  =  and  py  =  for 

i  *  k. 


Claim:  ®  LfUj)  =  {x  in  L(X):  p x  «  a^} . 


Proof  of  Claim:  Let  W  C  L(X),  p^  «  a k-  Then  W  =  w^ ,  w^  =  J\j.  KjfsJdP^Zj. 
F^(t)  =  Fw  (t),  Fw  (t)  =  J‘t|g1J2d|iz^.  where  Fy(t)  =  IIPtvll2.  From  these 


relations  and  p^  «  ak>  F^  (t)  =  J*  |gj  |2d^  =  J"1  l^daj^  for  all  i  i  M 


pt  1,  |2 . 


i 


However,  for  i  l  k.  p^  »  p^  while  by  hypothesis  ak  1  p^,  so  ak  1  p^  for 
i  2  k.  Now.  Sl  kll2dpz  =  J*  |ht  |2dcrk  for  all  t  in  T.  all  i  ^  M;  for  i  2  k. 

—00  i  — 00 

1*1.  |h.  |2do.  =  Sl\h.  |2do,  .  all  t.  while  J* |g. |2I .dp-  =  0.  all  t.  since 

_co  A  1  k  _«o  1  K  _«o1A^i 

^(A)  =  0.  Since  p^[A  n  (-®.t)]  =  J^Jgi  lhi  l^^k*  hi  =  0 

a.e.  dak,  i  l  k.  But  since  J^Jhj  I^A^k  =  l2<icrk  =  l2^  *  we 
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=  0  i  2  k,  since 


have  gj  =  0  a.e.  dp^  .  i  2  k.  This  gives  llw^ll* 


llw. 


i II2  =  JT|g1|2d»iz  .  and  so  W  =  Z  Wj.  with  Fw  (t)  =  Jt|gi|2d^z  =  |hi  |2dak  = 


i  -00 


t  2 

rih<  r^r^h  ;  since  the  Radon-Ni kodyn  derivative  dp™  /djiy  is  unique  up  to 
-®  1  mLZi  i  l  i 


a.e.  dp^  equivalence,  gj  =  |hj  |  j  [sign  (gj)].  a.e.  d^  . 

We  now  show  that  w^  €  L(u^).  where  u^  =  JT|  .  (sJdP^j.  We  have  P^  = 
t  f 

{jd^J  (s)dPsZi-  and  80 

/jihjCs) |(sign  gi)(s)dPgui 

=  J'T|hi(s)  {(sign  gi)(*)[^L)2(*)d*,sZi  =  XT  gi^s>dPsZi  =  wi • 

M  k-1 

Since  w  as  in  L(u  ) ,  W  =  X  w  belong  to  ©  L(u  ),  so  that 

1=1  1  1 

k-1 

{x  €  L(X) :  px  «  ak>  C  ©  LfUj). 

k-1 

To  prove  the  reverse  inclusion,  if  W  =  Z  J_  h  dP  u  = 

.  t  1  1  VI 


1=1 


k_1  <k7k1>*  k-1  2 

(by  definition  of  Uj)  X  Sj  hj  -r— —  I  (sJdP^,  then  F^( t )  =  X  J  h^d^, 

i = 1  Zj  i = 1  ® 


so 


^W  <<  a^.  The  Claim  is  proved. 

By  the  definition  of  v^t  it  is  clear  that  py  =  ak  for  i  £  k,  since 


P  v  = 
t  i  J-° 


Y1 


Thus,  we  have  py  «  ok  for  i  i  k  and  Vj  €  L(X),  so  by  the  Claim. 
k-1 

Vj  €  9  LtUj)  i  =  1 . k. 
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*V  A 

This  requires  that  v .  =  2  f~.  C.  .(s)dP  u.  all  i  £  k  where 

1  j_j  *  lj  s  J 

k-1  2 

2  /T  |C.  .(s)  |  dji  (s)  <  ».  i  £  k.  Since  the  definition  of  u.  gives  p  =  a, 
J=1  1  13  uj  J  uj  * 

k"1  ,  9 

for  J  i  k-1.  we  have  F  (t  }  =  u  (-«*. t]  =  ok(-».t]  =  2  J  jC  (s)|^dak(s) 

vi  i  vi  K  J=1  -»  J  K 

for  all  t  in  T.  all  i  i  k.  Thus, 
k-1  9 

2  |C.  ,(s)|  =  1  a.e.  do,(s)  for  i  =  1 . k. 

j=l  13 

Similarly,  since  Vj  €  L(Yj),  v^  €  L(Y^)  and  L(Y*)  1  L(Y3),  giving  1  PtVj 

for  i,J  £  k,  i  jt  J  and  all  s,t  in  T,  one  has  for  i  /  J 


0  “  EPtViPtVj 

=  (since  EP  u  P„u  .  =■  0  for  m  ^  m‘,  m.m'  £  k-1,  all  s,t) 
s  m  t  m 

V  £  clm(s)cy^u  (s) 

m=l  -®  m 


=  (since  pu  =  ok«  m  i  k-1)  2  J*  cim(s)C  (s)dok(s) 

m  m=l  -»  J 


■  f-l  x,ci»(s)Cj»(s)dok(s)' 


all  t  in  T.  Hence 


2  Clm(s)cjm(s)  =0  a.e.  dok(s)  for  i  /  J. 


We  now  have  a  family  of  k  vector-valued  functions,  C . ,  each  C.  having  k-1 
components.  Cj(s)  =  (0^jb(s) . Cj  )  such  that  a.e.  dok(s) 


z  iclt(s)r  =  i 

j=i  13 


i  =  1 . k 


jf1cu(*)c.j<s)  * 0  1  *  ■■ 
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Suppose  that  the  measure  ct^  gives  positive  measure  to  some  Borel  set  in 

T.  Then,  for  all  s  in  a  set  of  positive  measure,  we  have  a  set  of  k 
k-1 

elements  in  E  .  the  ith  being  (C^fs) . Cj  j ( s ) )  which  are  orthonormal . 

k-1 

Since  any  orthonormal  set  of  elements  belonging  to  E  can  contain  at  most 

k-1  elements,  this  contradiction  establishes  that  a ^  is  identically  zero. 

Hence,  we  have  (from  the  original  Lebesgue  decomposition  of  p  ,  )  p  .  <<  p  ,  . 

Yk  YK  ZK 


Thus. 


p  <<  p_  for  i  <  min(N.M). 
Y1  Li 

Suppose  now  that  M  <  N.  Define 


Ui  =  S1 


(s)d?2i  i  *  M 


Vi  =  JT  dp. 


(sJdP^j  i  $  M+l. 


We  then  have 


\  =  “^1  *  \  ^ 


®1  L(ut)  =  {w  £  LfZj):  m„  «  V u+j): 


equality  being  proved  as  in  the  case  of  the  Claim,  replacing  by  p^+j  . 


Since  p  «  p  „  .  for  i  £  M+l,  this  gives 


M+l  M 

©  L(v  )  C  9  L(u  ). 
1  1  1  1 


Proceeding  in  the  same  manner  as  for  previously,  one  obtains  that 
must  equal  zero.  This  shows  that  N  £  M.  proving  the  theorem. 


-  17  - 


Corollary-  Suppose  that 


L(X)  =  L(Z4)  «  S 

where  (P^Z^ }  are  m.s.  continuous  processes  and  have  ordered  spectral  measures, 

p^  >>  p^  .  n  <  M.  Then  If 
n  n+1 

L(X)  =  ©j  LfYj)  ©  » 

where  Py  >>  Py  n  £  1.  it  is  necessary  that  N  =  M  and  Py  <<  p^  <<  Py 
"n  n+1  n  n  n 

n  *  1 ,  •  •  •  •  M  • 

Proof :  It  remains  only  to  show  that  If  (Xt)  Is  m.s.  continuous  and 

N 

L(X)  =  ©  L(Z  ).  with  yi^  >>  y^  .  n  <  M.  then  p^  »  p  for  any  y  in  L(X). 
1=1  n  n+1  ^1  y 

But  y  in  L(X)  requires  that  y  =  J"q  hjdP^,  so  Fy(t)  =  /Q|hJJ2dFz 

and  since  yi^  «  yi^  for  all  1^1,  one  has  that  py  <<  pz  .  Q 

Lemma  5  makes  no  assumptions  on  the  discontinuities  of  (Pt);  in  fact, 
those  discontinuities  (if  any)  do  not  enter  into  the  representation.  Thus, 
one  obtains  another  corollary  to  Lemma  5,  stated  in  the  following  theorem.  It 
is  due  to  CramAr  [  ]  and  the  representation  it  contains  will  be  termed 
"Cram6r's  representation." 

Theorem  2-  Suppose  that  (Xt)  is  a  SOSP  satisfying  assumptions  (Al)  and  (A2) . 
Then  there  exists  {Zn>  n  £  1}  in  L(X)  such  that 

N 

L  (X)  =  9  L  (Z  ) 

1=1 

and  yiy,  >>  yi^  .  all  n  <  M.  If  also  there  exists  (Yn>  n  2  1}  in  L(X)  with 
n  n+1 

N 

L  fX)  =  9  L  fY  )  for  all  t  in  T. 
t  j_j  ‘  n 


-  18  - 


for  n  <  N,  then  N  =  M  and 


for  0  <  n  <  M. 


and  fjy  >>  *iy 

n  n+1 


Mz  ^  My  Mz 
n+1  n+1  n+1 


The  unique  number  M  (0  <  M  <  “}  is  the  multiplicity  of  (X^).  Any  x  in  Lt(X) 
has  the  representation 

M  t 

x=  2  J  G  (t.s)  dP  Z  , 
i=lJ0 

where  Gn(t.*)  is  in  ^  2 3h=1^0Gn(t,s)d*iZ  <  "* 


n 


n 


The  next  theorem  is  essentially  due  to  Hida  [  ];  the  representation  given 
will  be  termed  "Hida's  representation". 


Theorem  3:  Let  (X^).  t  €  T  (an  interval)  be  a  second-order  stochastic  process 
satisfying  assumptions  (Al)  and  (A2).  Then 

d(t4) 

xt  *  sy^t.s^js)  j(t)Qjj 


t4<t  j=i 


for  all  t  in  T,  where  the  equality  holds  in  L^C^.P.P) .  and  with  the  RHS  having 
the  following  properties: 

(1)  (B^)  is  a  mutual ly-or thogonal  family  of  m.s.  continuous  orthogonal- 

increment  stochastic  processes,  with  spectral  measures  (fig  )  satisfying 


n 


Mg  »  Mg  for  n£l . 
n  n+1 


(2)  Fn(t,s)  =  0  for  s  >  t  and  Fn( t . - )  belongs  to  1  ln  T.  all 

1  4  n 

M  9 

n  2  1.  and  Z  J  m|Fn(t.s)  |  djig  (s)  <  «  for  each  t  in  T. 
n=l  n 

(3)  (tj)  are  the  discontinuities  of  (Lt(X),  t  €  T) , 


Lt(X)  =  span{Xs.  s  $  t} 

L  (X)  *  0  L  (X). 

*i  s>tJ  s 


L2(n.p,p) 


;  i.e.,  those  points  t^  such  that 
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(4)  1  i  <i( t ^ )  i  «,  for  each  tj. 

(5)  {Qjj.  J  i  d(ti)*  i  1  1}  are  o.n.  elements  in  L^O.p.P). 

(6)  Q.  .  and  B  (t)  are  orthogonal  in  Lo(0./3.P),  for  n  £  M,  all  t  €  T, 

i  j  n  ^ 

J  S  dCtj).  i  *  1. 

(7)  f ±J(t)  =  <Xt.Qjj>  all  t.  (i.j).  and 

(8)  Lt(X)  =  Lt(Bn)  ©  spanfQ^.  j  <[  d^).  <  t}. 


Moreover,  if  (X^ }  has  a  representation 

xt  =  2?  st  Fn(t.s)dBn(s)  +  i  i  qi(t)Q;i 
t  l  n  n  t,*t  J=1 


where  (F^) .  (B^).  (Qjj),  (fjj)  have  properties  (l)-(8).  then  N  =  M.  the 

measures  Pg  and  jig,  are  mutually  absolutely  continuous  for  n  £  M, 
n  n 


d*JB 

F^(t.s)  =  Fw(t.s>3— ^  a.e.  dfig. .  n  £  M.  and  Q*  j  =  for  J  i  df^).  each 

n  n 

d(t:1) 

tj,  where  is  a  unitary  matrix  in  R 

The  multiplicity  of  (X^. }  is  then  defined  to  be  sup(M,  dim  S(X)). 


To  see  that  the  multiplicity  as  defined  in  Theorem  3  is  the  same  as  that 
defined  in  Theorem  2.  let  {Qjj.  j.  i  Mftj),  discontinuities  (tj)  of  ( ) }  be  a 
c.o.n.  set  in  ®(X)  such  that  Pt  Q^j  =  0,  P^  +Qjj  =  Qjj.  J  £  M(t^).  For  each 

ij.  (P^Q.,,)  ls  a  FND  01,  with  pn  giving  measure  one  to  t . ,  p.  {T  }c  =  0. 

t  lj  Wj  j  +  J  1 


'ij 


ij 


Let  (Bn)  be  such  that  C(X)  =  ®”_jL(Bn).  Define  (Z^)  by 


Z  =  B  +  Y 
n  n  n 


=  B 


n 


=  Y 


n 


n  i  min(M.  dim  »(X)) 
if  dim  9(X)  <  n  i  M 
if  M  <  n  i  dim  ®(X). 
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M(ti>  n 

where  n  <  00  in  all  cases.  The  sequence  (Y^)  is  given  by  Yfi  =  5LZ!j_j  aij^ij‘ 
where  the  {(a^):  n  £  1,  j  i  M(t^),  all  discontinuities  t.}  are  defined  as 
fol lows 


M(t  )  2 

2  2  1  a  =  1 .  and 
i  j=l  J 

a| j  *  0.  all  ij; 

Yn+1  1  spfYj . . . ,Yn) ,  all  n  >  1; 

a"*1  jt  0  if  and  only  if  €  sp{Y1 . Yg. . .  ,Yn> .  n  >  1. 

To  prove  that  L(X)  =  L(Zj).  it  is  sufficient  to  show  that  S(X)  = 

sp{Yn*  n  £  1}.  Since  (Qjj)  Is  a  c.o.n.  set  in  2>(X),  2>(X)  =  sp{Yn,  n  £  1}  if 

and  only  if  Qjj  €  sp{Yn>  n  ^  1}  for  all  ij.  Let  (Qjj)  t>e  the  set  of  all  (Qjj) 

such  that  (Qjj)  Is  not  in  sp{Yn<  n  ^  1}.  Then,  by  definition  of  (Y^) ,  there 

exists  an  element  Y  =  in  {Yn>  n  2  1}  where  /  0  if  and  only  if 

Q.  .  €  {Q’  :  Q!  €  sp{Y  ,  n  £  1}}.  This  requires  that  Y  IQ.’,  for  all  Q!.,  a 
ij  *  ij  ij  n  c  y/  M  ij  ij 

contradiction. 

The  representation  given  in  Theorem  3  is  called  the  proper  canonical 
representation  of  (X^).  Although  the  elements  (B^) ,  (Fn).  (Qjj)>  and  (fjj) 
appearing  in  the  representation  are  not  unique,  their  number  is  unique  and 
those  appearing  in  any  given  proper  canonical  representation  can  be  obtained 
from  the  corresponding  elements  of  any  other  such  representation. 

The  space  S(X)  consists  only  of  {0}  if  (Xt)  is  m.s.  continuous.  If  (P^) 
has  a  discontinuity  at  t^,  then  necessarily  (X^ )  is  not  m.s.  right-continuous 
at  t^;  we  have  seen  that  the  converse  does  not  hold.  In  order  for  (Pt)  to  have 
a  discontinuity  at  t^,  it  is  necessary  and  sufficient  that  fl  Lg(X)  contain  a 
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non-zero  element  orthogonal  to  L  (X). 

0 

Carol  Iarv-‘  Suppose  that  (X^ }  is  m.s.  continuous  on  T.  Then  for  all  t  in  T, 

M  t 

X  =  2  F  (t.s)dB  (s)  where  {F  (t,»),  n  £  M}  and  (B  ,  n  £  1}  are  as  in 
t  ,  -®  nv  '  n'  '  *  n  n 

n=l 

Theorem  3.  The  covariance  function  of  (X^)  has  the  representation 

M  . 

EX  X  =  £  jctSF  (t,u)F  (s.u)dpg  (u)  for  .  n  £  M}  defined  as  in  Theorem  3. 

1  s  n=l  n  n  n  n 

If  T  is  a  finite  interval.  T  =  [a.bj,  then  the  covariance  operator  of  (Xt). 

K  o 

R*:  L2[a.b]  -»L2[a.b],  has  trace  equal  to  Trace  =  E/”|Xt|  dt  = 

*  <u>- 

n=l  n 

Proof :  Follows  directly  from  Theorem  3. 

The  development  as  given  by  Hida  [5]  replaces  assumption  (Al)  with  the 

assumption  that  L(X)  is  separable  and  that  the  m.s.  limits  X£+  and  X£_  exist 

for  all  t.  L  (X)  is  then  defined  as  fl  L  (X).  The  projection  operator  P  is 
1  s>  t  S  C 

the  operator  with  range  equal  to  Lt(X).  The  family  {P^,  t  €  T}  is  then  a  right- 
continuous  resolution  of  the  identity.  This  defines  a  self-adjoint  linear 
operator  T  in  L(X).  T  =  J  mXdP*.  The  Hel linger-Hahn  Theorem  [6,  p.  247  ff.]  is 
then  applied  to  obtain  the  proper" canonical  representation. 

5.  General  Formulation  of  Spectral  Multiplicity 

The  preceding  results  were  derived  for  a  second-order  stochastic  process. 
However,  they  can  be  formulated  purely  in  terms  of  a  iven  self-adjoint 
operator  in  Hilbert  space.  The  following  result  contains  the  Hel linger-Hahn 
theorem  and  related  results  ([6],  Sec.  VII. 2),  and  consequences. 
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Theorem  4:  Let  T  be  a  self-adjoint  bounded  linear  operator  in  the  real 
separable  Hilbert  space  H.  Let  {P^,  X  €  IR)  be  a  left-continuous  resolution  of 
the  identity  determined  by  T.  Then: 

(1)  H  =  *€  ®  ®,  where  ®  is  the  closed  linear  span  of  all  eigenvectors  of  T, 
and  "€  =  S'*-; 

(2)  For  any  x  in  the  map  X  ->  IIP^xll  is  continuous; 

(3)  There  exists  an  orthonormal  basis  {en>  n  £  1}  for  <€  such  that  pn  >>  p  , 

all  n  2  1.  where  p^  is  the  Lebesgue-Stiel t jes  measure  on  IR  determined  by 

2 

the  non-decreasing  function  X  -»  HP.e  II  ; 

A  n 

(-4)  If  S  /  H,  {vn>  n  £  1}  is  any  other  basis  for  <€  such  that  >>  un+j  for 

2 

all  n  >  1.  where  v  is  determined  by  X  -»  IIP,v  II  .  then  u  ~  u  for  all 
n  An  n  n 

n  >  1 ; 


(5)  Suppose  that  <6  has  dimension  M  £  1,  and  that  {^n>  n  £  1}  and  {p^,  n  £  1} 
are  as  in  (3).  Let  {X^,  n  ]>  1}  be  the  set  of  distinct  eigenvalues  of  T, 
let  m(n)  be  the  dimensionality  of  the  subspace  spanned  by  the  eigen¬ 
vectors  for  the  eigenvalue  X  ,  and  let  (u*.  i  £  m(n)}  be  orthonormal 

n  n 

eigenvectors  corresponding  to  X  .  Then,  for  any  x  in  H  and  any  X  in  IR, 

there  exists  a  family  of  Borel-measurable  functions  {Fn(X,*),  n  £  M} , 

M  >  2 

depending  on  x.  such  that  2  J^jjF  (X , s )  |  dp  (s)  <  »,  and 

n=l  n  n 

M  .  m(n) 

P.x  =  2  J\T  (X.s)dP  e  +22  <u\x>u. 

X  ,  nv  '  s  n  n  n 

n=l  X  <X  1=1 

n 

Each  summand  in  the  first  term  on  the  RHS  of  this  expression  is  the 

K-l  * 

limit  of  partial  sums  of  the  form  2  y  F  (X,s,’)[P  -  P  ]e  ,  where 

k=0  n  k  Sk+1  Sk  n 

Sj  <  sj+j  for  0  <  i  £  K-l,  s^  €  and  the  limit  is  taken  as 

sup{sk+1  -  sk:  0  £  k  £  K-l}  -+  0  and  sK  t  "•  sQ  i 
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Proof :  This  theorem  is  simply  a  reformulation  of  the  preceding  results  on  the 


spectral  representation  of  a  purely  deterministic  m.s.  left-continuous  SOSP, 
replacing  L(X)  by  H.  The  only  use  made  of  the  assumptions  (Al)  and  (A2)  was  to 
show  that  L(X)  is  separable  and  to  establish  a  left-continuous  resolution  of 
the  identity,  the  family  (P^,  t  £  R}  of  Lemma  1.  Mean-square  left  continuity 
of  the  stochastic  process  (PtZ)  for  Z  in  L(X)  corresponds  to  left-continuity 
of  t  -*  IIPtZII. 

In  the  present  theorem,  the  given  operator  T  has  a  left-continuous 
resolution  of  the  identity.  The  space  H  is  assumed  to  be  separable.  The 
theorem  then  follows  from  Theorem  3  above.  _ 
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